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PREFACE 

This manual is compiled for the purpose of assisting teachers 
of mathematics in the administration and practical use of my 
First Year Algebra Scales. There is a feeling that the original mono- 
graph, which appeared in the Teachers College Contributions to 
Exiucation series, is too technical and, consequently, too difficult 
for most teachers to read intelligently and to determine from it 
with ease how to apply the scales most profitably. Suggestions 
concerning the purpose of these scales are incorporated in this 
manual in as simple and direct form as possible. Special training 
in statistical methods is not necessary for their comprehension. 

Besides the Tentative Standards of Achievement proposed in 
the original monograph, scores more recently obtained in various 
cities and through school surveys have been included. Suggestions 
on presentation and diagnosis of results have also been added. 
In order that the progress of a class may be more scientifically 
determined, a revision of the tests, with the exercises arranged in 
duplicate or alternate scales of equal difficulty, will be published 
in the near future. 



Henry G. Hotz 



UniversUy of Arkansas 
FayeUeoiUe, Arkansas 
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Teacher's Manual For 
First Year Algebra Scales 

The First Year Algebra Scales were first published in 1918.^ 
Since then they have been extensively used by teachers, school 
administrators, directors of educational research, and in various 
school surveys. 

I. DESCRIPTION OF SCALES 

The scales consist of five different sheets of algebraic exercises 
designed to measure the ability of pupils in elementary algebra. 
They are: 

1. Addition and Subtraction 

2. Multiplication and Division 

3. Equation and Formula 

4. Graphs 

5. Problems 

The first two scales, it will be seen, are designed to test the 
achievement of students in the fundamental operations, involving 
integral, fractional, and radical expressions; the second two, to 
test the ability of students in handling the instruments of quanti- 
tative thinking; while the last is composed of verbal problems of 
the type usually stressed in the first year of algebra. 

The exercises in each scale are arranged in order of difficulty; 
that is, each scale begins with exercises so easy that they can be 
solved by practically every member of a class. Each succeeding 
exercise, however, becomes increasingly more difficult so that the 
last ones in each scale can be solved by only a relatively small 
number of students who try them. 

Two series of each scale are offered — Series A and Series B. 
Series B is the longer and contains from eleven to twenty-five 
exercises in each scale. Series A is only about one half as long 
and contains from eight to twelve exercises in each scale. It covers 
just as wide a range of difficulty and has the added advantage of 
having the intervals between successive exercises and problems 
approximately equal: that is, Ex. 3 of a given scale is as much 
more difficult than Ex. 2, as Ex. 2 is more difficult than Ex. i. 

iHotz, Henry G.: First Year Algebra Scales, Teachers College, Columbia Univer- 
sity, Contributions to Education, No. 90. 
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In determining individual and class scores, the factor of primary 
importance is not so much how many exercises an individual can 
solve correctly in a given time, but rather how far along on the 
scale of exercises, arranged in order of increasing difficulty, he can 
perform satisfactorily. In other words, the pupil is measured 
almost entirely by the point which he reaches on the scale. For 
this reason the tests may very properly be technically called 
"scales," and are characterized as "difficulty tests" or "power tests'* 
by specialists in educational measurements. 

The scales were derived from data obtained from tests given to 
over 16,000 high-school students. The schools which cooperated 
in standardizing the scales varied all the way from the small rural 
high school to the large cosmopolitan high school. Classes were 
tested in eighty-four high schools located in the states of Massa- 
chusetts, Connecticut, Rhode Island, New York, New Jersey, 
Ohio, Wisconsin, Missouri, Oklahoma, Colorado, and Washington, 
and the results subjected to intricate statistical treatment. The 
difficulty of each exercise, or its position on the scale, was determined 
by the percentage of pupils solving each exercise correctly.* 

2. SELECTION OF SCALES TO BE USED 

Series A will be found on the whole to be more satisfactory 
than Series B, especially where the time available for testing 
purposes is limited. This is particularly true if the purpose of the 
test is primarily to determine degrees of attainment. If, however, 
the purpose of the test is mainly diagnostic, that is, to discover 
difficulties which the students are encountering. Series B should 
be used. It contains a richer variety of exercises and, consequently, 
a greater number of type processes. This makes it possible for 
teachers to make a more complete analysis of the mistakes made 
by pupils. 

If only one scale can be used, it should be the Equation and 
Formula Scale, because it is more comprehensive and so tests a 
much wider range of functions. At least two scales should be 
used, however, and the scale which undoubtedly comes second in 
importance is the Problem Scale. If Series A is used there will be 
ample time to give both during a single class period of forty minutes. 

* For a complete account of the method employed in locating each exercise on a linear 
scale, consult Hotz, Henry G. : First Year Algebra Scales, 
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Whenever it is possible to do so, all five of the tests of a given series 
should be used, since the achievement on all of the tests gives a 
much more reliable indication of a pupil's ability than the results 
from one or two tests would give. 

Teachers have found it most practicable to use the tests in 
rotation somewhat as follows: 

1. At the end of three months 

Addition and Subtraction Scale 
Equation and Formula Scale 

2. At the end of six months 

Multiplication and Division Scale 
Problem Scale 

3. At the end of nine months 

Equation and Formula Scale (repeated) 
Graph Scale 

Whenever it is desired to use the same scale a second time, it 
is advisable to select it from a different series. It is feared that 
unless at least six months' time has elapsed since a given test was 
used some of the practice effect may survive. 

3. WHEN TO GIVE THE TESTS 

The scales may be used very profitably as early as the end of 
the third month of the school year. 

Tentative Standards of Achievement,' based upon the 16,000 
papers of the original study, were compiled for three-, six-, and 
nine-month intervals. It is, therefore, much more satisfactory for 
comparative purposes to submit these scales to algebra classes 
immediately after they have studied algebra for three, for six, or 
for nine months. However, data on the achievement at other 
intervals are being collected constantly, much of which is 
included in this pamphlet,* and as time passes more and more 
information with regard to the achievement that may reasonably 
be expected at other intervals will become available. 

The scales are not intended to be used beyond the first year. 
For this reason very few results from classes having had algebra 
more than ten months have been reported. 

» See p. 26. 

* See pp. 27-34. ' 
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4. DIRECTIONS FOR ADMINISTERING THE TESTS 

1. Preliminary. Before passing the papers see that the desks are 
cleared and pupils are provided with pencils. For the graph test rul- 
ers should also be provided. Then make the following statement: 

"I am going to give you a test to see how well you can 
solve exercises in algebra. Papers will be passed to you 
with the printed side down. Please leave them so until 
I tell you to turn them over." 

2. Pass the papers, or have them distributed by the pupils in 
the front seats, with the printed side down (Series B, first page 
down) and the top end away from the pupil. 

3. When all are ready say to the class: 

"Turn your papers. Write your name in the first blank 
space," etc. (The number of blank spaces to be filled out 
may be determined by the one giving the test. It is not 
necessary to have all filled in. Some teachers simply 
have pupils write their names in the upper right hand 
corner of the blank page so as to prevent the pupils from 
seeing any of the exercises before all of the directions 
have been given.) 

4. Then repeat one of the following series of directions, depend- 
ing upon the tests to be given: 

Addition and Subtraction Scale 

"Attention! The exercises on these sheets are in addi- 
tion and subtraction — collection of terms. Take the ex- 
ercises in the order in which they are given. Work as 
many as you can and be sure you get them right. Work 
directly on these sheets and do not ask anybody any 
questions. When you have worked all the exercises you 
can, lay aside your pencils and remain quiet so as not 
to disturb those who are still working. You will have 
twenty minutes in which to work (Series B, forty minutes). 
Start." 

Multiplication and Division Scale 

"Attention! The exercises on these sheets are in multi- 
plication and division. Take the exercises in the order in 
which they are given. Work as many as you can and be 
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sure you get them right. All answers must be reduced to 
their simplest forms. Work directly on these sheets and 
do not ask anybody any questions. When you have worked 
all the exercises you can, lay aside your pencils and re- 
main quiet so as not to disturb those who are still work- 
ing. You will have twenty minutes in which to work 
(Series B, forty minutes). Start." 

Equation and Formula Scale 

"Attention! On these sheets you are given a number 
of equations and formulae to solve. Take the exercises 
in the order in which they are given. Solve as many as 
you can and be sure you get them right. Work directly 
on these sheets and do not ask anybody any questions. 
When you have worked all the exercises you can, lay aside 
your pencils and remain quiet so as to not disturb those 
who are still working. You will have twenty minutes in 
which to work (Series B, forty minutes). Start." 

Graph Scale 

"Attention! On these sheets you are given a number 
of graphs. Read each question carefully and then do 
as you are told to do. Take the exercises in the order in 
which they are given. Answer as many questions as you 
can and be sure you get them right. Work directly on 
these sheets and do not ask anybody any questions. 
When you have answered all the questions you can, lay 
aside your pencils and remain quiet so as not to disturb 
those who are still working. You will have twenty-five 
minutes in which to work. Start." 

Problem Scale 

"Attention! On these sheets you are given a number 
of questions to answer. Take the exercises in the order 
in which they are given. Answer as many questions as 
you can and be sure you get them right. In all the prob- 
lems which call for the equation, for example No. 4, 
simply state the equation which will solve the problem. 
Take for example, this problem: A coat and hat cost 
$30. The coat cost 5 times as much as the hat. Find 
the cost of each. The equation would he x + ^x = $30. 
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(Write the equation on the board.) Work directly on 
these sheets and do not ask anybody any questions. 
When you have answered all the questions you can, 
lay aside your pencils and remain quiet so as not to dis- 
turb those who are still working. You will have twenty-five 
minutes in which to work (Series B^ forty minutes). Start." 

5. When the time is up, say "Stop" and collect the papers. 
Most of the pupils will have finished before this time. Those who 
have not, in all probability have done all they can. 

A warning, stating the amount of time left, should be given 
three minutes before time is called for the tests of Series A and five 
minutes in advance for those of Series B. 

With many classes which have had less than nine months of 
algebra, and especially those which have had only three months, it 
is perfectly safe to call time before the full time allowed for that 
particular test has elapsed. 

Students may be provided with scratch paper for their own use. 
It has been found to be most satisfactory to pass quietly down the 
aisles a few minutes after the test is started and give each pupil 
a sheet of scratch paper. Pupils will find it more convenient, how- 
ever, to work directly on the question sheets. For all but the 
problem test it is desirable to have as much of the work as possible 
on these sheets. 

5. DIRECTIONS FOR SCORING THE PAPERS 

In scoring the papers, answers are to be marked either right or 
wrong. All answers which may be accepted as correct are given 
on pages 13 to 19 of this manual. A few incorrect answers are 
also listed, to indicate more definitely the types of answers 
which must not be accepted. 

No credit is given for answers that are partially right. Tnis 
procedure, though somewhat arbitrary, greatly simplifies the task 
of scoring the papers. It saves time and offers less chance for 
variation in scoring the results. This last factor, uniformity in 
scoring, is an absolute essential in order that valid comparisons 
between different school systems may be made. 

After each paper is scored, it has been found most convenient 
to record the total number of exercises solved correctly in the 
upper right-hand comer of the test sheet. 
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Answer Key to Addition and Subtraction Scale 



Problem 
No. 


Answers 


Problem 
No. 


Answers 


I 


9'- 
5* 


16 


2r^ 2r^ 


2 


f2-z2»(^_2) (r+2) 


3 


15^ 


17 


7 -4a 
6a 


4 


-hc?'^ 


18 


9— 6x 9 6x 
4 ' 4 4 


5 
6 


6x + 2 
8a -66 


19 


33,2 _ 5^ 
2:)cy 


7 


m 

5^ 


20 


5 -3a 


8 


(a+i) (a2-a+i)' 


9 


r-^t + s 




5 -3a 
a3 + i 


10 


5C + 6 
a2-66+4 


21 


40-13^ 


II 


(^-3) (^-2) (:^+5)' 








40-130: 


12 


^x — i 




0(?-i9x+so 


T t 


3^. 6c 
8' 16 


22 


I I 

1 1 • ^ II 


13 


(x—iy a^—3x^+sx—i 


14 


7^ . 
6 


23 


5sV5; not 5 VS + 1 \/5 


15 


a— 2ac 
a^— 3c^ 


24 


6a — 7 7— 6a 
a2-4'4-a« 
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Answer Key to Multiplication and Division Scale 



Problem 
No. 


Answers 


Problem 
No. 


Answers 


I 
2 


2iy 

3» 
8o«6* 

-26 

— I2ie*>i» 

2OT— 3W 

2X* 
5 

ioa« + 33a«-52a + 9 

«*+I0 

4 
30 


14 

15 
16 

17 
18 

19 
20 

21 

22 
23 


4a:-8;4(a;-2) 
6 6 


3 

4 

5 
6 

7 
8 

9 

lO 

II 

12 

13 


a{m—n)* am^an 
8ix*y^ 

c +a; not j- 

c— a 

4 

12^2; 123^2 

1 2a--i 
a — ; 

2 2 

p-2 _ />-2 

3K^-9)'3^^~27r 

^-3^ + 9.^^-3^ + ^ 
3(^-3) ' 3^-9 

48 
3 
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Answer Key to Equation and Formula Scale 




Problem 
No. 



2 
3 

4 

5 
6 

7 
8 

9 



10 -T 



II 

12 

13 
14 



Problem 
No. 



15 



16 



17 



18 



19 



20 



21 



22 



23 



24 



25 



Answers 



3 
154 

m 

R 



I ^ I 

--;not — ; 
2 -2 



nor —x^- 
2 

10,-5 (both roots) 
-5, —I*; not —x^s 



^=2,y=4* 



I 190 
21-; -^ 
9 9 



(23. rr. I , — 



♦ Where two results are ordinarily required in an answer, the exercise is marked 
correct if the work is done correctly up to the point where only one value is obtained 
ind stopped at that. If, however, the student makes an error in solving for the second 
/alue, the problem is scored incorrect. 
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8 

9 

10 



II 



12 



13 



14 





Answer Key to Problem Scale 




Problem 
No. 


Answers 


I 


3^ 




2 


m — r 




3 


a + b 




4 


X + ioa; = 132. ($12 and $120) 




5 


980 

V 




6 


4X + 40 = 240; 2X + 2(x — 20) = 240; 4X - 

(50 ft. X 70 ft.) 


40 



Sx — 136 = 836; 2x — 136 = 836 — x; X + ^ 
and x = 23^ — 136. (324 children and 512 adulti 



; not dwx = r 



dw 



{x + 12) (^ - 4) = x\ (6 ft. X 6 ft. and 2 ft. X i 

2i : Sf = 20 :x; x : 20 = 5 ft. 9 in. : 2 ft. 6 in.; c 
69:30; eight times as high as the man; not 2.6 
20 : X. (46 ft.) 



X + y == 5000 and -^ 
"^ *^ 100 

4(5000 - x) 



+ 



4y ^ 
100 



172; 



3^ 



+ 



= 172; .033c + 200 — .04:x 



100 ' 100 

($2800 and $2200) 

40^ = 55(^ - 2); 553c = 40{x + 2); ^ - 2 = 
(293>^ miles) 



40 



X -\- y = 20 and 50X + 65^ = 1200; 50X + 65(20 
1200; not 50X + 65(20 — x) = 12. (6^ lbs. a 
lbs.) 

5x^ = 180; 5(^ — 10)2 = 180. (16 in. X 16 in.) 



The equations given above are those which are usually found. Mod 

which in the end equal the same, may be accepted. For example, 4X = 240 - 

, 69 * . , " , „„ 

same as 4* — 40 = 240, and — = — is the same as 69 : 30 = « : 20. Wliere 

30 20 
lems have been worked out and the correct answers are given, they are to 
as correct, though such a procedure on the part of students is to be die 
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Answer Key to Graph Scale 



Problem 
No. 




I. 


2000 


2. 


24 


3. 


3330 to 3350 
(inclusive) 



5. 
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and 

9. 



-3 to -9 
(inclusive) 
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The score assigned to each pupil for each test is the total number 
of "rights," that is, the total number of exercises solved correctly 
in the test. Individual scores made on the various tests by the 
different pupils of a class may be recorded on a sheet similar to 
Fig. I. 



City 

School Teacher. 



Date 



Grade. 



Names of Pupils 



Scores on EUich Test 



II 



III 



IV 



Median Score 



Standard Score 



Fig. I 
Individual Class Record Sheet Used in Recording the Results for Each Class 



DETERMINING THE MEDIAN OR CLASS SCORE 2 1 

6. DIRECTIONS FOR DETERMINING THE MEDIAN OR CLASS SCORE 

The median number of exercises correctly solved is used in 
connection witli these scales as the class score. Though not entirely 
accurate scientifically, it is the most readily computed and is, 
therefore, for all practical purposes the most satisfactory measure 
of the achievement of a class. The median score represents the 
number of exercises solved correctly by just fifty per cent of a 
class. That is, there are just as many students in a class who solve 
a larger number as there are students who solve a smaller number 
of exercises. 

In order to determine the median point of the achievement of a 
class, it is necessary to make a distribution table of the results 
of a test. Such a table shows the number of pupils who were unable 
to solve a single exercise correctly, the number who solved one 
exercise correctly, two exercises, three exercises, etc. Sample dis- 
tributions for four of the tests. Addition and Subtraction, Multi- 
plication and Division, Equation and Formula, and Problems, are 
shown in Table I, (page 22). Another distribution is given in 
Table II, (page 23). 
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TABLE I 

Distribution Table Showing Scores Attained for Four of the 

Tests, Okmulgee, Oklahoma * 

City Okmulgee State Oklahoma Date June iq2I 

School High Teacher Grade gth 

Remarks g-month group 





Number of Pupils Making Score Indicated 


No. of 

Examples 




Addition 


Multiplica- 


Equation 






Correct 


and 


tion and 


and 


Problems 


Graphs 




Subtraction 


Division 


Formula 






25 












24 












23 












22 












21 












20 












19 












18 












17 












16 












15 












14 












13 












12 


6 


6 


12 






II 


5 


8 


12 






10 


17 


9 


12 


2 




9 


16 


9 


12 


6 




8 


17 


21 


19 


II 


« 


7 


II 


14 


9 


10 




6 


7 


12 


9 


16 




5 


7 


9 


7 


19 




4 


5 


6 


2 


i^ 




3 


4 


4 


2 


12 




2 


2 






4 




I 

























Total 


97 


98 


96 


98 




Median 


8,74 


8.19 


9.0 


S'79 




Standard 


7-9 


7^9 


7^8 


5^6 


1 



* Form used by Bureau of Educational Research, University of Illinois, Urbana, 11 
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Table II also indicates in a clear and concise way the method 
of computing the median class score.* Since a thorough knowledge 
of the method of calculating the median is essential to the proper 
use of these scales, it is urged that teachers who are not familiar 
with educational statistics make a careful study of this table. 



TABLE II 

Sample Distribution of Scores Made on Equation and Formula 

Test, Series B 



Score 


Number of Pupils 
Making Each Score 


Computation of Median 


20 

19 
18 

17 
16 

15 

14 

13 
12 

II 

ID 

9 

8 

7 
6 

5 
4 

3 

2 

I 



nil 

mil 
Hill II 

nil 

1 
1 


2 

4 
3 
5 
7 
3 
4 

3 

2 

I 
I 


1. After checking the problems correctly 
solved, count the check marks in eacn 
paper, and indicate the number in the 
proper place in column 2. 

2. Find the total number of scores (N). 

N 

3. Median equals middle score = — 

Thus. 1 = ^ - ,7K 

Beginning at i in the third column 
and counting up, it is necessary to 
count 3K of the 7 to make 17K, thus: 

I7>^ = 1+1+2 + 3+4 + 3 and 
3^ of the 7. 

Put 3J^ as a numerator over 7 and 
add to 13, the step on which the 7 
occurs, thus: 


Total Scores (N) 


35 


Median = 13 + ^ = 13.5 


Median Score 


13.5 


/ 



Errors in computing the median or class score are very common; 
and, when comparison is to be made with standard scores, an error 
of one-half point in its computation may do serious injustice to 
a class. As a further safeguard against error in this important de- 
tail, four additional class distributions are submitted in Table III, 
and a complete discussion of the method of determining the median 
or class score of these distributions follows. 

• The method suggested here is an adaptation of the plan used by Clifford Woody in 
his The Woody Arithmetic Scales and How To Use Them, p. 19. 
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TABLE III 



Sample Distribution of Scores ^Iade bt Four Different Classes on 

Equation and Formula Test 



Number of 

Problems 

Solved 


Class 

I 


Class 
II 


Class 
III 


Class 
IV 


o 










I 


I 




2 




2 


2 


I 


I 


I 


3 


2 




2 


3 


4 


I 




I 


2 


5 


4 


I 


2 


3 


6 


6 


5 


3 


2 


7 


3 


4 


I 




8 


3 


3 


I 


3 


9 


2 


2 


2 


4 


lO 


I 


I 


I 


2 


II 


I 


I 




I 


12 










13 








1 


14 




I 






15 


* 








Total 


26 


19 


i6 


22 


Median Score 


6.5 


7.6 


6.0 


7-5 



According to this table, there were twenty-six students in Class I, 
nineteen students in Class II, sixteen students in Class III, and 
twenty-two students in Class IV. In Class I one student solved 
one problem correctly, two solved two problems correctly, twa 
solved three correctly, etc. To find the median score of this class,, 
it is necessary to find the point in the distribution of the class wher^^ 
there are just as many students who solved a greater number of 
problems as there are students who solved a smaller number- 
Since there are twenty-six students in the class, this point is obvi- 
ously midway between the scores made by the thirteenth and 
fourteenth students, counting down in the distribution. That is, 
to include the thirteenth individual with the poorer group, it is 
necessary to count three of the six students who solved six prob- 
lems; and, since it is assumed that the individuals are distributed 
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evenly through a step at equal distances from one another, the 

median point is just one half of the distance through this step, from 

six to seven. Therefore, the median score of this class is 6.5 problems 

solved correctly. 

In Class II there are nineteen students. Thus, there are 9.5 

individuals both above and below the exact median point in the 

distribution of this class. To include 9.5 individuals with the 

poorer group, it is necessary to count 2.5 of the 4 students who 

2.5 
solved 7 problems. Hence, the median point is just of the 

4 
distance through the 7th step, which makes the median score of 

this class 7.6 problems solved correctly. 

Class III illustrates another situation still. There are 16 students 
in the class, and in counting out the 8 individuals for the poorer 
group, we exactly take up all the cases in the 5th step. The fact 
to be noticed here is that the median point is raised clear through 
the 5th step. The median score for this class, therefore, is 6.0 
problems correctly solved. 

Class IV is here included to assist in the solution of another dif- 
ficulty which is often encountered. There are 22 individuals in the 
class. Counting from the top of the distribution, the 11 cases for 
the poorer group take us, as seen above, entirely through step 6. 
Likewise, counting from below, to include 11 cases, we have to go 
clear through step 8. From this it appears that the median point 
could be located all the way from 7 to 8 in the class distribution. 
Since, however, any given distance on a scale is best represented 
by its middle point, the median score of this class should be 7.5 
problems solved correctly. 

7. STANDARDS OF ACHIEVEMENT 

Tentative standards of achievement were proposed in the orig- 
inal monograph.^ When these were published, the scales had not 
been used very extensively, and some doubt was expressed with 
regard to the reliability of the tentative standards. There is as 
yet, however, no conclusive evidence that any of these standards 
should be materially revised. 

There is some evidence that the tentative standards are on the 
whole a little too high. On the other hand, whenever the tests 

^ Hotz, Henry G: First Year Algebra Scales, p. 41. 
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have been submitted to classes in large high schools, where t 
teaching is generally more efficient and where there is more carei 
selection of the subject matter taught in elementary algebra, t 
results invariably surpass these standards. 

TABLE IV 
Tentative Median Standards of Achievement, Series A 





Three-Month 


Six-Month 


Nine-Monti 




Group 


Group 


Group 


Addition and Subtraction 


5.0 


6.8 


7.9 


Multiplication and Division 


5.3 


6.3 


7.9 


Equation and Formula 


4.9 


7.1 


7.8 


Problem Test 


4.3 


4.9 


5.6 


Graph Test 


2.8 (four 


and one-half 


5.6 




months) 





TABLE V 
Tentative Median Standards of Achievement, Series B 





Three-Month 


Six-Month 


Nine-Mont 




Group 


Group 


Group 


Addition and Subtraction 


97 


12.9 


14.4 


Multiplication and Division 


9.6 


14.0 


16.3 


Equation and Formula 


7.8 


14.3 


16.0 


Problem Test 


54 


6.5 


7.5 . 


Graph Test 


3.7 (four 
n 


and one-half 
lonths) 


7.2 



STANDARDS OF ACHIEVEMENT 2^ 

TABLE VI 

^^MMARY OF Median Scores Attained in Various Cities with First Y 

Algebra Scales, Series A 

Addition and Subtraction Scale 



City 


No. of Months of Algebra Studied 


3 


6 


8 


9 


10 


14 


inois Cities 








6.9 


7.3 




Rural Schools 




4.3 


4.9 








fginia < Small City Schools 




5.2 


5.9 








Large City Schools 


3.6 


5.3 


50 








Jorth [ Rural Schools 


3-3 


3.7 




4.5 




4.9 


,. ^ Small City Schools 


2.9 


54 




3.9 




4.3 


Large City Schools 


3.6 


3.9 








54 


lantic City, N. J. 




74 










ading. Pa. 




3.9 










evidence, R. I. 














(Moses Brown School) 




6.7 








10.5 


Lyetteville, Ark. 














(University H. S.) 


5.1 


5.3 




7.5 






yetteville, (City H. S.) 


5-3 












ttle Rock, Ark. 




4.9 




6.0 






tsdam, N. Y. 




6.3 










ratoga, N. Y. 




54 










nira, N. Y. 




6.1 










litehall, N. Y. 




6.9 










«s of Original Study 


5.0 


6.8 




7.9 


» 



* Multiplication 


r and Division Scale 






I City 




No. of Months of Algebra 


Studied 




3 


6 


8 


9 


10 


14 


\ Cities 








7.2 


74 




k Ohio 


3.8 






4.8 




5.2 


Ig, Pa. 




3.9 










|nce, R. I. 














ies Brown School) 




7-7 








10.4 


Wille, Ark. 














Wrsity H. S.) 


5.6 


5.9 




6.8 






t, N. Y. 




6.7 










IN.Y. 




5.8 










|N. Y. 




6.2 










t. Y. 




5.9 










in, N. Y. 








74 






Original Study 


5.3 


6.3 




7.9 
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TABLE VI 

Summary of Median Scores Attained in Various Cities with First Year 

Algebra Scales, Series A 

Equation and Formula Scale 



City 



Virginia 



Illinois Cities 

Rural Schools 
Small City Schools 
Large City Schools 

(Rural Schools 
Small City Schools 
Large City Schools 
Reading, Pa. 
Atlantic City, N. J. 
Chicago, 111. 

(Research Study by Eleanora Harris) 
Providence, R. I. 

(Moses Brown School) 
Fayetteville, Ark. 

(University H. S.) 
Philadelphia, Pa. 
Little Rock, Ark. 
Lockport, N. Y. 
Potsdam, N. Y. 
Saratoga, N. Y. 
Whitehall, N. Y. 
Amsterdam, N. Y. 



Cities of Original Study 



No. of Months of Algebra Studied 



4.0 
3.2 
3.1 
3-3 



5-9 



4.9 



1.6 
4.6 

5.4 
4.2 

2.8 

4.5 
1.8 

6.2 



9.0 

6.3 

6.0 

7.3 
6.4 

5.4 
7.8 



7.1 



8 



3-9 
5.8 

5.1 



I'l 



4.7 
1.5 



8.6 
6.8 
6.8 



8.1 



7.8 



10 



7.9 



6.3 



14 



4-9 
5.1 
5.5 



6.9 
9.8 
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TABLE VI 

3F Median Scores Attained in Various Cities with First Year 

Algebra Scales, Series A 
Graph Scale 



City 


No. of Months of Algebra Studied 


4>^ 


6 


8 


9 


10 


12 


14 


111. 

:h Study by 
^nora Harris) 
le, Ark. 
sity H. S.) 
5, R. I. 

Brown School) 
^a. 
:ies 

1, Kans. (1919) 
1, Kans. (1920) 
I, Kans. (1921) 
rroup 
Group 
oup 

• 

1 

:hools) 

\t City, Mo. 

:k, N. J. 

n, N. Y. 


2.3 


4.5 

6.5 

1.8 

7.8 




6.0 

6.2 
6.6 
6.4 

4.8 
4.6 

5.6 

2.5 


4.7 
5.0 

5.2 


7.3 


6.8 

4.2 

7.4 


riginal Study 


2.8 






5.6 
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TABLE VI 

Summary of Median Scores Attained in Various Cities with First Yeaj 

Algebra Sca es, Series A 

Problem Scale 



City 




No. of Months of Algebra 


Studied 


3 


6 


8 


9 


10 


14 


Illinois Cities 








6.4 


5.0 




Athens, Ohio 


1.9 






2.5 




3.8 


Reading, Pa. 




2.0 










Chicago, 111. 














(Research Study by 














Eleanora Harris) 










4.3 




Providence, R. I. 














(Moses Brown School) 




5.8 








7.2 


Mount Holly, N. J. 






3.6 








Fayetteville, Ark. 














(University H. S.) 


4.3 


4-3 




6.2 






Saratoga, N. Y. 




4.2 










Elmira, N. Y. 




4.9 










Amsterdam, N. Y. 








5.5 






Cities of Original Study 


4.3 


4.9 




5.6 
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TABLE VII 

Y OF Median Scores Attained in Various Cities with First Year 

Algebra Scales, Series B 

Addition and Subtraction Scale 



City 


No. of Months of Algebra Studied 


3 


6 


8 


9 


10 


12 


14 


d, Ohio 




14.7 












dlle, Ark. 
















»rsity H. S.) 


94 














sey Cities 


12.0 














Wis. (1919) 


130 


17.3 












Wis. (1920) 


13.6 


18.8 












in Cities (1918) 


11.2 






14.4 








in, 22 Cities (1921) 




14.8 












on, Kans. (1919) 








18.1 








on, Kans. (1920) 








15.9 








on, Kans. (192 1) 
















Group 




19.5 












ge Group 








14.1 








Sroup 








10.8 








h City, N. J. 








12.8 








', Mass. 








lO.O 








^est City, Mo. 








17.0 








ack, N. J. 




12.0 






14.5 


18.0 


20.0 


Id, Ark. 


10.8 


12.6 


I2.I 










: Original Study 


9.7 


12.9 




14.4 
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TABLE VII 

Summary of Median Scores Attained in Various Cities with First Yi 

Algebra Scales, Series B 

Multiplication and Division Scale 



City 


No. of Months of Algebra Studied 


















3 


6 


8 


9 


10 


12 


I 


Cleveland, Ohio 




14.8 












New Jersey Cities 




154 












Racine, Wis. (19 19) 


136 


18.1 












Racine, Wis. (1920) 


14.7 


18.6 












Waukesha, Wis. 


14.0 














Wisconsin Cities (19 18) 


11.4 






17.4 








Wisconsin, 23 Cities (192 1) 




16.2 












Wellington, Kans. (1919) 








18.3 








Wellington, Kans. (1920) 








17.4 








Wellington, Kans. (1921) 
















Rapid Group 




17.0 












Average Group 








14.0 








Slow Group 








13.1 








Andover, Mass. 








14.2 








Iron wood, Mich. 




II.O 












Hackensack, N. J. 




10.4 






15.9 


16.5 


IS 


Paragould, Ark. 


"3 


131 


14.9 










Cities of Original Study 


9.6 


14.0 




16.3 









STANDARDS OF ACHIEVEMENT 33 

TABLE VII 

Summary of Median Scores Attained in Various Cities with First Year 

Algebra Scales, Series B 

Equation and Formula Scale 



^^» M 


No. of Months of Algebra Studied 


City 


3 


6 


8 


9 


10 


12 


14 


Cleveland, Ohio 
I^ort Smith, Ark. 
INew Jersey Cities 
I^acine, Wis. (1919) 
TRacine, Wis. (1920) 
Wisconsin Cities (19 18) 
Wisconsin, 28 Cities (1921) 
Wellington, Kans. (19 19) 
Wellington, Kans. (1920) 
Wellington, Kans. (1921) 

Rapid Group 

Average Group 

Slow Group 
Elizabeth City, N. C. 
Andover, Mass. 
Iron wood, Mich. 
Cold Springs, N. Y. 

(Holdane School) 
Hackensack, N. J. 
Paragould, Ark. 


7.2 

13.5 

II.O 


14.9 

9.9 
16.3 

17.5 
15.9 

14.2 
20.6 

6.4 

9.0 
12.5 


15.8 


17.2 

18. 1 
16.7 

14.4 

1 1. 2 
12.8 
12.8 


145 


20.0 


20.3 


Cities of Original Study 


7.8 


14.3 




16.0 
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TABLE VII 

Summary of Median Scores Attained in Various Cities with First Ybax 

Algebra Scales, Series B 

Problem Scale 



City 


No. of Months of Algebra Studied 


3 


6 


8 


9 


10 


12 


14 


Cleveland, Ohio 




6.3 












Fort Smith, Ark. 


4.7 


5.0 












New Jersey Cities 








7.0 








Waukesha, Wis. 






7.9 










Wisconsin Cities (1918) 








8.2 








Wisconsin, 31 Cities (192 1) 




7.1 












Wellington, Kans. (191 9) 








9.8 








Wellington, Kans. (1920) 








94 








Wellington, Kans. (1921) 




. 












Rapid Group 




11.4 












Average Group 








7.8 








Slow Group 








5.8 








Elizabeth City, N. C. 








8.1 








South West City, Mo. 








8.3 








Mississippi (Two Schools) 








4.7 




6.3 




Cold Springs, N. Y. 
















(Holdane School) 


5.8 














Hackensack, N. J. 




5.5 






5.3 


5.9 


54 


Paragould, Ark. 


7.0 


6.1 


74 










Cities of Original Study 


54 


6.5 




7.5 









8. GRAPHICAL REPRESENTATION AND STATISTICAL INTERPRETATION 

OF RESULTS 

After the papers for one or more of the tests of a class have 
been scored, and the median has been computed, the results should 
be entered in tabular form on an Individual Class Record Sheet 
similar to the one shown in Fig. i (p. 20). 

In large school systems it is usually necessary to combine the 
individual scores of various classes. For this purpose the tabula- 
tion shown in Table I (p. 22) has been devised. In order to save time, 
teachers very frequently use this form of tabulation for individual 
classes as well and compute the medians directly from these dis- 
tributions. 
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TABLE VIII 

Summary of Results m Equation and Formula Test, Series B, 

Fort Smith, Arkansas 



^\mrt^ 


Three-Month 


Six-Month 


OlA/lC 


Group 


Group 


20 




I 


19 






18 




I 


17 




2 


16 




2 


15 




6 


14 


I 


4 


13 


2 


6 


12 


3 


7 


II 


9 


5 


10 


10 


9 


9 


26 


7 


8 


22 


II 


7 


35 


6 


6 


28 


9 


5 


26 


3 


4 


12 


4 


3 


7 


4 


2 


7 




I 


9 







4 




Number of Pupils 


201 


87 


Median Score 


7.2 


9.9 



Table VIII represents, in somewhat greater detail, the results 
^f one of the tests in a city high school having several algebra 
classes. It shows the distribution of the group that has studied 
cilgebra for three months, and the distribution of the group that 
has studied algebra for six months. Such a table indicates the 
extent of variation within a group and also the excessive amount 
of overlapping that exists between the two group distributions. 

The facts in this table may be more strikingly portrayed if 
presented graphically as in Fig. 2. In this graph the results of 
two groups are drawn upon the same scale, one placed above the 
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Other. In constructing these graphs, the -ST-axis represents the 
scores attained by the various pupils, and the F-axis the per- 
centage of pupils making each score. 

Graphs of this type furnish a most efficient means for showing: 
(i) The wide range of abilities within a group. (2) The scores 

Per Cent 
or PapilB, 



Ihrc 9-110X1131 Group 
. (SOI Pupils) 



Per Cent 
of Pupils 




'Is' I4 \6 la 26 



Six-Month Qroup 
(87 Pupils) 



Fig. 2. Distribution and Median Scores, Equation and Formula Test, Series B, 

Fort Smith High School, Fort Smith, Ark. 

most frequently made by pupils of a group. (3) The extent to which 
a group falls short or surpasses the median standard achievement, 
as indicated by the distance between the median for the group and 
the standard median. (4) The amount of progress made from group 
to group, as indicated by the distance between the group medians. 
(5) The amount of overlapping between the groups. In Fig. 2, 
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this last factor, the excessive amount of overlapping, is undoubt- 
edly the most significant. It will be seen that 29 per cent of the 
pupils of the three-month group do as well as or better than, the 
median pupil in the six-month group, and that about 24 (24.4) 
per cent of the pupils of the six-month group fall below the achieve- 
ment of the median pupil in the three-month group. 

It is sometimes desirable to represent graphically the scores 
attained by each individual pupil in a given test. This is done in 
Fig* 3» where the results obtained from an entire class in the Addi- 
tion and Subtraction Scale are exhibited. Here each pupil's score 



800T« 



Soora 



10 



I 

10 


» 

K 
*■ 

?_^ ^^ Claaa l!edian . ■ ■ t 












■ 


5 


, Standard 




































• 





















































■ 



12 3 4 5 6 7 8 9 10 11 12 13 U 15 16 17 18 19 20 21 22 23 24 

(Saoh line represents a pupil* s score) 

Fig. 3. Individual Scores of a Six-Month Group, Addition and Subtraction 
Test, Series A, Moses Brown School, Providence, R. I. 

• 

IS represented by a vertical line, the height of the line indicating 
the size of the score. Thus the relative standing of each and every 
pupil is vividly portrayed. It will be seen that the best student 
m this class does more than five times as well on this test as the 
poorest student. 

When a composite picture of the achievement of a pupil on all 

five tests is desired, a graph similar to that in Fig. 4 is suggested. 

The scores of five different pupils on each of the five different tests 

are here exhibited. The short horizontal lines indicate the median 

score of the class. Pupil A, it is evident, surpassed the median 

Scores of the class in all of the tests; pupils B, C, and D fell below 

these medians in one or more tests; and pupil E did very poorly 

in all but the Multiplication and Division Test, in which he did 

exceptionally well. The relative standing of the members of a 

class is more readily determined from this graph if pupils are 

arranged roughly in order of excellence of achievement. 
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In Fig. 5 the median scores made in a city high school on all 
of the tests in 1920 are compared with the scores made in the same 
school in 19 19 and with the standard scores. It is at once evident 
that the median scores made in 1920 are all well above the stand- 
ard but not quite as high as the 1919 median scores. 

A most interesting graph of results from the same school is re- 
produced in Fig. 6. These data were obtained during the school 
year of 1920-21, and clearly illustrate the advantage of homo- 
geneous grouping of pupils. At the beginning of the year all first 
year algebra pupils were divided into three sections on the basis 
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Letters represent dififerent pupils; perpendicular lines, pupil's individual scores in (z) Addition 
and Subtraction, (a) Multiplication and Division, (3) Equation and Formula, (4) Graph, (s) 
Problem, tests respectively; horizontal cross bars: — class median; - - - standard median. 

Fig. 4. Individual Scores Attained by Pupils from a Six-Month Group on All 
Tests, Series A, Moses Brown School, Providence, R. I. 

of results obtained with the Otis Intelligence Tests. The pupils 
making the highest grades in the intelligence test, 29 in all, were 
placed in one group and covered a year and a half of work in 
algebra in nine months. Twenty-two pupils were placed in the slow 
section and about 70 in the normal group. The bright group was 
tested at the end of six months and the other two groups at the 
end of nine months. The graph indicates that the normal group, 
covering the usual amount of ground, made a satisfactory showing 
on all the tests; and, moreover, that the bright group, at the end 
of six months, as shown by the results, possessed the ability to 
solve the algebra exercises that was far superior even to that 
represented by the nine-month standard. 



REPRESENTATION AND INTERPRETATION OF RESULTS 
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Fig. 5. Comparison of Median Scores Attained in 1919 and 1930, 

Series B, Wellington High School, Wellington, Kana. 
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6. Comparison of Median Scores Attaned by Bright Group, Median Group, 
and Slow Group in All of the Tests, Series B, Wellington High School, 
Wellington, Kans. 
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9. ANALYSIS OF ERRORS 

There is a tendency on the part of teachers and administrators 
to use standard tests merely for the purpose of determining de- 
grees of attainment. Large numbers, the majority of the teachers 
perhaps, consider the net results, as shown by individual and class 
scores, as the all-important objective in the use of standardized 
tests. Such knowledge of total scores achieved is valuable, but it 
is merely the first step in the process of securing greater efficiency 
in instruction through the use of standard testing devices. Tests 
have other values which are much more significant to the class- 
room teacher. They should be used much more extensively to 
reveal weaknesses in teaching and to aid in the diagnosis of dif- 
ficulties encountered by pupils. 

In the analysis of the results of a test, the types of problems 
causing special difficulty are usually quite readily disclosed, but 
it is a much more intricate matter to determine with any degre^^ 
of precision the mental processes that may be responsible for th( 
various errors. 

Three studies on the analysis of errors most frequently made i 
algebra are here reported in Tables IX, X, and XI. 



TABLE IX 

Classification of 4A3 Errors* Most Frequently Made by Pupils of 
Fort Smith (Ark.) High School in the Equation and Formula Test.. 

Series B 

1. Performing wrong operation in solving for unknown: 

2 2 

Ex. 7. — 8=6 or — z = 6 

3 3 

12 ,2 
2= — 8 = 6 • 

3 3 

2. Error in sign in transposition: 

Ex. 4. 5a + 5 =61—30 
5a — 3a = 61 + 5. 

3. Simple arithmetical errors: 

Ex. 3. 3« = 9 — 3 
3* = 9. 

• Fort Smith Survey: Classification of Errors in Algebra, made under the direct/on 
of A. M. Jordan, of the University of Arkansas. 
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4. Error in using the four fundamental operations of algebra: 

Ex. 5. 7» - 3n = 12 — 4 
io» = 8. 

Ex. 8. c — 2 (3 — 4c) = 12 
c — 2 — 6 — 8c = 12. 

5. Adding denominators in addition of fractions: 

Ex. 12. — +— = A 
3 4 2 

X= A. 

7 2 

6. Incomplete solution: 

Ex. 12. 43^ + 3y =■ 30 

7y = 30. 

Ex. 18. — 4* =s 2 
— X = i. 

7. Error in sign in division: 

Ex. 6. — 32 = — 6 
« = — 2. 

8. Error in copying: 

Ex. 14. 7w — 3n = 12 
7» — 3» «=» 12. 

Ex. 12.-^=--^+— 
3 42 

3 2 

9. Using exponent for coefficient : 

Ex. 19. p2 - 5/> = 50 
- 3/> = 50. 

to. Error in substituting the value of the unknown in a formula: 

Ex. 16. Area of a triangle = § bh. 

Find area when 6 = 10 ft. 
and h = 8 ft. 

Area of triangle = 5 X 4 = 20. 

II. Solving for wrong unknown in a formula: 
Ex. 17. RM = EL, solve for M. 

M 



42 



FIRST YEAR ALGEBRA SCALES 



1. Performing the wrong operation In 

solTlng for unknown 

2. Srror in sign in transposition 

3. Simple arithnetical errors 

4. "KrroT in using the four fUndaiMntal 

operations in algebra 

6. Adding denoninators In addition of 
fractions 

6. Znoomplets solution 

7. Xrror In sign In dlTlsloa 

8. Xrror in copying 

0. Using sscponent for'cosfflclent 

10. Xrror in substituting the ralue of 

the unknown in a formula 

11. So lying for the wrong unknown In a 

formula 

12. Uno lass if led 




2.1 
449 100;( 



Fig. 7. 

Distribution of 443 Errors made by Three- and Six-Month Groups on 

Equation and Formula Test, Series B 
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TABLE X 

SuiufART OF Errors Made by Pupils in 36 Wisconsin High Schocx^s* on 
Four Tests, Series B, March and April, 192 i 

Per Cent 
of Total 
No. Errors 
Addition and Subtraction Test 

Failure to deal with parentheses correctly 38 

Failure to write the denominator of a fractional answer 24 

Wrong process (adding instead of subtracting, for example) 18 

Writing the sum of the numerators for a new numerator and the sum of 

the denominators for a new denominator 4 

Errors whose cause could not be discovered 8 

Miscellaneous errors 8 

Total 100 

Multiplication and Division Test 

Mistakes in dealing with exponents 37 

Using the wrong process 14 

Mistakes in the use of signs 13 

Mistakes in factoring 11 

Failure to deal with parentheses correctly 6 

Errors whose cause could not be discovered 11 

Miscellaneous errors 8 

Total 100 

Equation and Formula Test 

Failure to change signs when transposing 28 

Multiplying by the coefficient of the unlmown in order to solve .... 18 

Use of wrong process 10 

Nlistakes in solving literal formulae 8 

Hrrors in dealing with parentheses 7 

Xf istakes in substitution in formulae 7 

Poinding one root only in solving a quadratic 7 

iDividing by the numerator of the coefficient of the unknown in order to 

solve . 6 

Errors which could not be explained 5 

Miscellaneous errors 4 

Total 100 

Problem Test 

Errors due to ignorance of fundamental relationships (Those in length, 

breadth, thickness, and volume for example) 52 

Errors due to misreading the problem 41 

Errors which could not be explained 7 

Total 100 

•Osbum, W. J.: Survey of Algebra Instruction in Wisconsin High Schools. These 
pupils had studied algebra for six months. The total number of pupils tested varied 
from 1055 to 1635. Some of the schools did not find it possible to give all four tests. 
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TABLE XI 

Classification of Errors»oMost Frequently Made by Pupils of the Fort 
Smith (Ark.) High School in the Problem Test, Series B 



1. Incorrect operation indicated, usually due to failure to comprehend the 
problem. Caused 55 per cent of the errors. 

Prob. I : If a coat costs x dollars, how much will 3 coats cost? 
Answer: x — 3. 

2. Conditions of the problem apparently understood, but the work left 
in incomplete form. Caused 15 per cent of the errors. 

Prob. 7. The total number of circus tickets sold was 836. The number 
of tickets sold to adults was 136 less than twice the number sold to 
children. How many were sold of each? 

Answer: x = No. of children's tickets sold 

2x — 136 = No. of adults* tickets sold. 

3. Failure to comprehend the problem, perhaps due to confusion and to use 
of technical terms. Caused 10 per cent of the errors. 

Prob. 6. The width of a basket ball court is 20 feet less than its length. 
What is the length and width of the court if the perimeter (distance 
around) is 240 feet? 

Equation: x — x — 20 = 240. 

4. Inverting the order of terms in subtraction and in division. Caused 5 per 
cent of the errors. 

Prob. 2: A man is tn years old: how old was he r years ago? 
Answer: r — f», 

Prob. 5. The distance from Chicago to New York is 980 miles. If a 
train runs v miles an hour, what is the time required for the run? 

Answer: -?— 
980 

5. Simple arithmetical errors. Caused 5 per cent of the errors. 

6. Attempt to solve problems containing two unknowns with only one 
equation containing the two unknowns. Caused 2 per cent of the errors. 



10. VALUE OF FIRST YEAR ALGEBRA SCALES 

These scales may be used by teachers for three distinct and very 
useful purposes. They may be used (a) to indicate attainment, (b) 
to measure progress, and (c) to diagnose difficulties. 

Scales which increase in difficulty by approximately equal steps 
furnish a most reliable objective means for determining the actual 

10 Fort Smith Survey: Classification of Errors in Algebra, made under the direction 
of A. M. Jordan, of the University of Arkansas. 
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achievement of a student or a group of students. Any one of the 
scales may be used for this purpose, though the Equation and 
Formula Scale is perhaps to be preferred, since, as previously stated, 
it is a more comprehensive test. It is well to keep in mind also, in 
this connection, that a low median class score is not always, nor 
even quite generally, due to poor instruction. Any one or a com- 
bination of several causes may be operating to keep a class score 
down. It is the duty of the teacher, however, to study these causes 
and to learn which ones are affecting the efficiency of the instruc- 
tion, in order that proper remedial measures may be applied. This 
it is possible to accomplish with a much greater degree of certainty 
when the teacher knows the actual standard of achievement a class 
has attained. Such knowledge furnishes the teacher with a fact 
basis upon which to proceed and a motive with which to operate. 

The extent of progress made by a class can be quite scientifically 
measured by submitting the same scale to a class at intervals of 
about three months. Teachers should be cautioned very specifi- 
cally, however, not to do any drill work upon the exercises or 
problems appearing in the scales. If it is feared that some of the 
practice effect may survive, it is suggested that another scale in 
the same series, or the same scale in a different series, be used for 
the second test.^^ The most desirable method of measuring progress, 
very naturally, would be to have another parallel series of scales 
similar and equal in difficulty to those of Series A, and it is to be 
hoped that such a series will soon be constructed. 

For diagnostic purposes the scales of Series B have been found 
to be more serviceable. They offer a richer variety of exercises and, 
therefore, a greater number of type processes. Hence, a more com- 
plete analysis of the mistakes made by students, and the difficulties 
they encounter, is made possible. 

Finally, it must be stated emphatically that these are primarily 
power tests and as such should never be used for purposes of drill. 
Furthermore, with the time limits as now fixed, they are speed tests 
to a limited extent only. If a pure speed test is desired, the Stand- 
ard Tests^ devised by Dr. H. O. Rugg could be used to advantage. 
These would be particularly useful in determining whether a class 
has had sufficient drill upon the fundamentals. 

" See suggestions for using the scales in rotation, p. 9. 
"See School Review, October, 1917, 25:546. 
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« 

The scales may be secured from the publishers: Bureau of 
Publications, Teachers College, Columbia University, New York 
City, or from the following distributing centers: Public School 
Publishing Co., Bloomington, Illinois; Bureau of Educational 
Measurements and Standards, State Normal School, Emporia, 
Kansas. 
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